Solver Square Comparison

Solver Square Comparison: Considers all models.

Date / Time: 08/25/08 16:26:12

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC12 is represented on the left (rows) and solver CBC20 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

Tracefile 1 :	`22.5.trc`
Tracefile 2 :	`22.7.trc`
Solvers used :	`CBC12`
	`CBC20`
Modeltype(s)	`MIP`

	CBC20: optimal	CBC20: feasible	CBC20: infeasible	CBC20: unbounded	CBC20: fail	CBC20: no data	total CBC12
CBC12: optimal	-	-	-	-	-	-	`-`
CBC12: feasible	`68`	`2`	-	-	-	-	`70`
CBC12: infeasible	-	-	-	-	-	-	`-`
CBC12: unbounded	-	-	-	-	-	-	`-`
CBC12: fail	`13`	`19`	-	-	`8`	-	`40`
CBC12: no data	-	-	-	-	-	-	`-`
total CBC20	`81`	`21`	`-`	`-`	`8`	`-`	`110`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	8 or 16	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 10 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

CBC12: feasible -- CBC20: optimal Back to top

Modelname	Time (CBC12)	Time (CBC20)	Ratio (CBC12/CBC20)	Obj (CBC12)	Obj (CBC20)
`acc-tight-0`	`36.1500`	`3.8400`	`9.414`	`0.00000000`	`0.00000000`
`acc-tight-1`	`397.4500`	`6.0500`	`65.694`	`0.00000000`	`0.00000000`
`acc-tight-4`	`105.8300`	`8.5600`	`12.363`	`0.00000000`	`0.00000000`
`air03`	`5.0600`	`5.1800`	`0.977`	`340160.00000000`	`340160.00000000`
`air04`	`124.9700`	`298.6500`	`0.418`	`56137.00000000`	`56137.00000000`
`air05`	`348.7400`	`422.5000`	`0.825`	`26374.00000000`	`26374.00000000`
`bal8x12`	`1.0100`	`1.7300`	`0.584`	`471.55000000`	`471.55000000`
`bell3a`	`15.2900`	`3.1600`	`4.839`	`878430.31600000`	`878430.31600000`
`bk4x3`	`0.0000`	`0.0100`	`---`	`350.00000000`	`350.00000000`
`blend2`	`14.1500`	`12.4600`	`1.136`	`7.59898500`	`7.59898500`
`cap6000`	`57.7900`	`12.4000`	`4.660`	`-2451377.00000000`	`-2451377.00000000`
`dcmulti`	`2.5200`	`6.7100`	`0.376`	`188182.00000000`	`188182.00000000`
`dsbmip`	`46.7700`	`1.0800`	`43.306`	`-306.76901203`	`-306.76901203`
`egout`	`0.0200`	`0.0300`	`---`	`568.10070000`	`568.10070000`
`enigma`	`14.6200`	`6.1600`	`2.373`	`0.00000000`	`0.00000000`
`fiber`	`4.4900`	`2.0000`	`2.245`	`405935.18000000`	`405935.18000000`
`fixnet6`	`8.7200`	`11.5100`	`0.758`	`3983.00000000`	`3983.00000000`
`gen`	`0.4800`	`0.1900`	`2.526`	`112313.36271800`	`112313.36271800`
`gesa2`	`89.8500`	`11.2300`	`8.001`	`25779856.37169790`	`25779856.37169790`
`gesa2_o`	`500.3600`	`42.3500`	`11.815`	`25779856.37169790`	`25779856.37169790`
`gesa3`	`5.2900`	`11.6000`	`0.456`	`27991042.64838270`	`27991042.64838270`
`gesa3_o`	`7.0600`	`13.1500`	`0.537`	`27991042.64838270`	`27991042.64838270`
`gr4x6`	`0.0200`	`0.0300`	`---`	`202.35000000`	`202.35000000`
`gt2`	`0.4700`	`0.0500`	`9.400`	`21166.00000000`	`21166.00000000`
`irp`	`87.6500`	`244.0700`	`0.359`	`12159.49283600`	`12159.49283600`
`khb05250`	`0.2800`	`0.4600`	`0.609`	`106940226.00000000`	`106940226.00000000`
`l152lav`	`35.7100`	`23.8300`	`1.499`	`4722.00000000`	`4722.00000000`
`lseu`	`2.1400`	`1.7700`	`1.209`	`1120.00000000`	`1120.00000000`
`mas284`	`63.5000`	`31.0800`	`2.043`	`91405.72368220`	`91405.72368220`
`mas76`	`424.9300`	`241.3000`	`1.761`	`40005.05414200`	`40005.05414200`
`misc03`	`9.8400`	`3.3400`	`2.946`	`3360.00000000`	`3360.00000000`
`misc06`	`0.8300`	`1.3400`	`0.619`	`12850.86073738`	`12850.86073738`
`misc07`	`95.1000`	`108.7200`	`0.875`	`2810.00000000`	`2810.00000000`
`mitre`	`8.6200`	`10.1600`	`0.848`	`115155.00000000`	`115155.00000000`
`mod008`	`1.2200`	`1.7800`	`0.685`	`307.00000000`	`307.00000000`
`mod010`	`8.3100`	`1.1200`	`7.420`	`6548.00000000`	`6548.00000000`
`mod011`	`264.7600`	`248.0700`	`1.067`	`-54558535.01422730`	`-54558535.01422730`
`modglob`	`38.7200`	`30.0400`	`1.289`	`20740508.08630820`	`20740508.08630820`
`neos4`	`168.6800`	`42.0800`	`4.009`	`-4.8603440750589E+10`	`-4.8603440750589E+10`
`neos5`	`165.2900`	`33.9300`	`4.872`	`-4.8603440750589E+10`	`-4.8603440750589E+10`
`nw04`	`49.5300`	`25.0300`	`1.979`	`16862.00000000`	`16862.00000000`
`p0033`	`0.2400`	`0.0600`	`4.000`	`3089.00000000`	`3089.00000000`
`p0201`	`15.9700`	`7.6800`	`2.079`	`7615.00000000`	`7615.00000000`
`p0282`	`4.8200`	`3.1900`	`1.511`	`258411.00000000`	`258411.00000000`
`p0548`	`12.7100`	`0.5800`	`21.914`	`8691.00000000`	`8691.00000000`
`pk1`	`447.1800`	`129.1600`	`3.462`	`11.00000000`	`11.00000000`
`pp08acuts`	`763.5900`	`40.0900`	`19.047`	`7350.00000000`	`7350.00000000`
`pp08a`	`35.7800`	`75.2400`	`0.476`	`7350.00000000`	`7350.00000000`
`prod1`	`123.2600`	`134.6000`	`0.916`	`-56.00000000`	`-56.00000000`
`qnet1`	`8.1900`	`7.1300`	`1.149`	`16029.69268100`	`16029.69268100`
`qnet1_o`	`5.9500`	`6.2200`	`0.957`	`16029.69268100`	`16029.69268100`
`ran10x10a`	`10.4600`	`3.5300`	`2.963`	`1499.00000000`	`1499.00000000`
`ran10x10b`	`4.5800`	`2.3800`	`1.924`	`3073.00000000`	`3073.00000000`
`ran10x10c`	`12.0600`	`11.3300`	`1.064`	`13007.00000000`	`13007.00000000`
`ran10x12`	`9.6200`	`2.5900`	`3.714`	`2714.00000000`	`2714.00000000`
`ran10x26`	`537.9800`	`112.6900`	`4.774`	`4270.00000000`	`4270.00000000`
`ran12x12`	`248.1500`	`47.1800`	`5.260`	`2291.00000000`	`2291.00000000`
`ran13x13`	`534.5600`	`169.8700`	`3.147`	`3252.00000000`	`3252.00000000`
`ran17x17`	`251.3200`	`26.1100`	`9.625`	`1373.00000000`	`1373.00000000`
`ran4x64`	`9.3100`	`1.9500`	`4.774`	`9711.00000000`	`9711.00000000`
`ran6x43`	`4.2400`	`3.7100`	`1.143`	`6330.00000000`	`6330.00000000`
`rentacar`	`11.6400`	`6.0900`	`1.911`	`28882470.94755350`	`28882470.94755350`
`rlp2`	`97.6400`	`3.9600`	`24.657`	`19.00000000`	`19.00000000`
`stein27`	`2.1700`	`2.9500`	`0.736`	`18.00000000`	`18.00000000`
`stein45`	`57.4100`	`64.5800`	`0.889`	`30.00000000`	`30.00000000`
`swath1`	`579.6000`	`743.8200`	`0.779`	`379.07129575`	`379.07129575`
`vpm1`	`1.3800`	`0.2000`	`6.900`	`20.00000000`	`20.00000000`
`vpm2`	`9.6500`	`8.6600`	`1.114`	`13.75000000`	`13.75000000`

CBC12: feasible -- CBC20: feasible Back to top

Modelname	Time (CBC12)	Time (CBC20)	Ratio (CBC12/CBC20)	Obj (CBC12)	Obj (CBC20)
`neos2`	`30.9400`	`1800.5500`	`0.017`	`454.86469703`	`468.53452713`
`neos3`	`224.6600`	`1800.7300`	`0.125`	`368.84275100`	`387.48814776`

CBC12: fail -- CBC20: optimal Back to top

Modelname	Time (CBC12)	Time (CBC20)	Ratio (CBC12/CBC20)	Status (CBC12)	Obj (CBC20)
`10teams`	`1800.3200`	`35.9300`	---	`mstat(14) sstat( 2)`	`924.00000000`
`bienst1`	`NA`	`103.6800`	---	`mstat(13) sstat(13)`	`46.75000000`
`bienst2`	`NA`	`762.9600`	---	`mstat(13) sstat(13)`	`54.60000000`
`harp2`	`1800.8100`	`1788.4700`	---	`mstat(14) sstat( 2)`	`-73889532.00000000`
`neos1`	`1800.6300`	`970.2200`	---	`mstat(14) sstat( 2)`	`19.00000000`
`neos6`	`1801.3700`	`441.4500`	---	`mstat(14) sstat( 2)`	`83.00000000`
`p2756`	`NA`	`2.4300`	---	`mstat(13) sstat(13)`	`3124.00000000`
`qiu`	`1800.1100`	`293.6300`	---	`mstat(14) sstat( 2)`	`-132.87313695`
`ran12x21`	`1800.0200`	`247.7600`	---	`mstat(14) sstat( 2)`	`3664.00000000`
`ran16x16`	`1800.0400`	`992.1700`	---	`mstat(14) sstat( 2)`	`3823.00000000`
`ran8x32`	`1800.0100`	`43.7500`	---	`mstat(14) sstat( 2)`	`5247.00000000`
`rgn`	`NA`	`3.5000`	---	`mstat(13) sstat(13)`	`82.19999924`
`bell5`	`1802.7200`	`82.9300`	---	`mstat(14) sstat( 2)`	`8966406.49152000`

CBC12: fail -- CBC20: feasible Back to top

Modelname	Time (CBC12)	Time (CBC20)	Ratio (CBC12/CBC20)	Status (CBC12)	Obj (CBC20)
`arki001`	`1800.7300`	`1801.4900`	---	`mstat(14) sstat( 2)`	`7582515.66574672`
`bc1`	`NA`	`1803.2900`	---	`mstat(13) sstat(13)`	`3.33836255`
`bc`	`1801.5600`	`1801.8500`	---	`mstat(14) sstat( 2)`	`7.00000000`
`binkar10_1`	`1801.6600`	`1801.6600`	---	`mstat(14) sstat( 2)`	`6746.64002300`
`danoint`	`1800.4100`	`1800.9200`	---	`mstat(14) sstat( 2)`	`66.37500000`
`fast0507`	`1811.0100`	`1806.2800`	---	`mstat(14) sstat( 2)`	`179.00000000`
`mkc1`	`1800.6000`	`1800.4400`	---	`mstat(14) sstat( 2)`	`-607.20700000`
`mkc`	`1800.5000`	`1802.2200`	---	`mstat(14) sstat( 2)`	`-534.34200000`
`ran14x18`	`1801.8300`	`1802.8000`	---	`mstat(14) sstat( 2)`	`3735.00000000`
`rout`	`1801.5800`	`1802.4900`	---	`mstat(14) sstat( 2)`	`1077.56000000`
`set1ch`	`1801.4900`	`1802.4400`	---	`mstat(14) sstat( 2)`	`54555.00000000`
`seymour1`	`1802.2400`	`1825.8300`	---	`mstat(14) sstat( 2)`	`411.08574808`
`seymour`	`1802.0600`	`1802.5000`	---	`mstat(14) sstat( 2)`	`435.00000000`
`swath2`	`1800.6400`	`1801.1400`	---	`mstat(14) sstat( 2)`	`387.63980365`
`swath`	`1800.6400`	`1802.1400`	---	`mstat(14) sstat( 2)`	`517.86689600`
`markshare1`	`1803.9500`	`1804.5300`	---	`mstat(14) sstat( 2)`	`11.00000000`
`markshare2`	`1803.0400`	`1803.2400`	---	`mstat(14) sstat( 2)`	`14.00000000`
`mas74`	`1800.0400`	`1803.5200`	---	`mstat(14) sstat( 2)`	`11801.18572900`
`noswot`	`1800.5900`	`1758.7600`	---	`mstat(14) sstat( 2)`	`-41.00000000`

CBC12: fail -- CBC20: fail Back to top

Modelname	Time (CBC12)	Time (CBC20)	Ratio (CBC12/CBC20)	Status (CBC12)	Status (CBC20)
`acc-tight-2`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`acc-tight-3`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`acc-tight-5`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`acc-tight-6`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`dano3_3`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`dano3_4`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`dano3_5`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`
`dano3mip`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`

CBC12: feasible: Back to top

Modelname	Time (CBC12)	Obj (CBC12)
`acc-tight-0`	`36.1500`	`0.00000000`
`acc-tight-1`	`397.4500`	`0.00000000`
`acc-tight-4`	`105.8300`	`0.00000000`
`air03`	`5.0600`	`340160.00000000`
`air04`	`124.9700`	`56137.00000000`
`air05`	`348.7400`	`26374.00000000`
`bal8x12`	`1.0100`	`471.55000000`
`bell3a`	`15.2900`	`878430.31600000`
`bk4x3`	`0.0000`	`350.00000000`
`blend2`	`14.1500`	`7.59898500`
`cap6000`	`57.7900`	`-2451377.00000000`
`dcmulti`	`2.5200`	`188182.00000000`
`dsbmip`	`46.7700`	`-306.76901203`
`egout`	`0.0200`	`568.10070000`
`enigma`	`14.6200`	`0.00000000`
`fiber`	`4.4900`	`405935.18000000`
`fixnet6`	`8.7200`	`3983.00000000`
`gen`	`0.4800`	`112313.36271800`
`gesa2`	`89.8500`	`25779856.37169790`
`gesa2_o`	`500.3600`	`25779856.37169790`
`gesa3`	`5.2900`	`27991042.64838270`
`gesa3_o`	`7.0600`	`27991042.64838270`
`gr4x6`	`0.0200`	`202.35000000`
`gt2`	`0.4700`	`21166.00000000`
`irp`	`87.6500`	`12159.49283600`
`khb05250`	`0.2800`	`106940226.00000000`
`l152lav`	`35.7100`	`4722.00000000`
`lseu`	`2.1400`	`1120.00000000`
`mas284`	`63.5000`	`91405.72368220`
`mas76`	`424.9300`	`40005.05414200`
`misc03`	`9.8400`	`3360.00000000`
`misc06`	`0.8300`	`12850.86073738`
`misc07`	`95.1000`	`2810.00000000`
`mitre`	`8.6200`	`115155.00000000`
`mod008`	`1.2200`	`307.00000000`
`mod010`	`8.3100`	`6548.00000000`
`mod011`	`264.7600`	`-54558535.01422730`
`modglob`	`38.7200`	`20740508.08630820`
`neos2`	`30.9400`	`454.86469703`
`neos3`	`224.6600`	`368.84275100`
`neos4`	`168.6800`	`-4.8603440750589E+10`
`neos5`	`165.2900`	`-4.8603440750589E+10`
`nw04`	`49.5300`	`16862.00000000`
`p0033`	`0.2400`	`3089.00000000`
`p0201`	`15.9700`	`7615.00000000`
`p0282`	`4.8200`	`258411.00000000`
`p0548`	`12.7100`	`8691.00000000`
`pk1`	`447.1800`	`11.00000000`
`pp08acuts`	`763.5900`	`7350.00000000`
`pp08a`	`35.7800`	`7350.00000000`
`prod1`	`123.2600`	`-56.00000000`
`qnet1`	`8.1900`	`16029.69268100`
`qnet1_o`	`5.9500`	`16029.69268100`
`ran10x10a`	`10.4600`	`1499.00000000`
`ran10x10b`	`4.5800`	`3073.00000000`
`ran10x10c`	`12.0600`	`13007.00000000`
`ran10x12`	`9.6200`	`2714.00000000`
`ran10x26`	`537.9800`	`4270.00000000`
`ran12x12`	`248.1500`	`2291.00000000`
`ran13x13`	`534.5600`	`3252.00000000`
`ran17x17`	`251.3200`	`1373.00000000`
`ran4x64`	`9.3100`	`9711.00000000`
`ran6x43`	`4.2400`	`6330.00000000`
`rentacar`	`11.6400`	`28882470.94755350`
`rlp2`	`97.6400`	`19.00000000`
`stein27`	`2.1700`	`18.00000000`
`stein45`	`57.4100`	`30.00000000`
`swath1`	`579.6000`	`379.07129575`
`vpm1`	`1.3800`	`20.00000000`
`vpm2`	`9.6500`	`13.75000000`

CBC12: fail: Back to top

Modelname	Time (CBC12)	Status (CBC12)
`10teams`	`--`	`mstat(14) sstat( 2)`
`acc-tight-2`	`--`	`mstat(13) sstat(13)`
`acc-tight-3`	`--`	`mstat(13) sstat(13)`
`acc-tight-5`	`--`	`mstat(13) sstat(13)`
`acc-tight-6`	`--`	`mstat(13) sstat(13)`
`arki001`	`--`	`mstat(14) sstat( 2)`
`bc1`	`--`	`mstat(13) sstat(13)`
`bc`	`--`	`mstat(14) sstat( 2)`
`bienst1`	`--`	`mstat(13) sstat(13)`
`bienst2`	`--`	`mstat(13) sstat(13)`
`binkar10_1`	`--`	`mstat(14) sstat( 2)`
`dano3_3`	`--`	`mstat(13) sstat(13)`
`dano3_4`	`--`	`mstat(13) sstat(13)`
`dano3_5`	`--`	`mstat(13) sstat(13)`
`dano3mip`	`--`	`mstat(13) sstat(13)`
`danoint`	`--`	`mstat(14) sstat( 2)`
`fast0507`	`--`	`mstat(14) sstat( 2)`
`harp2`	`--`	`mstat(14) sstat( 2)`
`mkc1`	`--`	`mstat(14) sstat( 2)`
`mkc`	`--`	`mstat(14) sstat( 2)`
`neos1`	`--`	`mstat(14) sstat( 2)`
`neos6`	`--`	`mstat(14) sstat( 2)`
`p2756`	`--`	`mstat(13) sstat(13)`
`qiu`	`--`	`mstat(14) sstat( 2)`
`ran12x21`	`--`	`mstat(14) sstat( 2)`
`ran14x18`	`--`	`mstat(14) sstat( 2)`
`ran16x16`	`--`	`mstat(14) sstat( 2)`
`ran8x32`	`--`	`mstat(14) sstat( 2)`
`rgn`	`--`	`mstat(13) sstat(13)`
`rout`	`--`	`mstat(14) sstat( 2)`
`set1ch`	`--`	`mstat(14) sstat( 2)`
`seymour1`	`--`	`mstat(14) sstat( 2)`
`seymour`	`--`	`mstat(14) sstat( 2)`
`swath2`	`--`	`mstat(14) sstat( 2)`
`swath`	`--`	`mstat(14) sstat( 2)`
`markshare1`	`--`	`mstat(14) sstat( 2)`
`markshare2`	`--`	`mstat(14) sstat( 2)`
`mas74`	`--`	`mstat(14) sstat( 2)`
`bell5`	`--`	`mstat(14) sstat( 2)`
`noswot`	`--`	`mstat(14) sstat( 2)`

CBC20: optimal: Back to top

Modelname	Time (CBC20)	Obj (CBC20)
`10teams`	`35.9300`	`924.00000000`
`acc-tight-0`	`3.8400`	`0.00000000`
`acc-tight-1`	`6.0500`	`0.00000000`
`acc-tight-4`	`8.5600`	`0.00000000`
`air03`	`5.1800`	`340160.00000000`
`air04`	`298.6500`	`56137.00000000`
`air05`	`422.5000`	`26374.00000000`
`bal8x12`	`1.7300`	`471.55000000`
`bell3a`	`3.1600`	`878430.31600000`
`bienst1`	`103.6800`	`46.75000000`
`bienst2`	`762.9600`	`54.60000000`
`bk4x3`	`0.0100`	`350.00000000`
`blend2`	`12.4600`	`7.59898500`
`cap6000`	`12.4000`	`-2451377.00000000`
`dcmulti`	`6.7100`	`188182.00000000`
`dsbmip`	`1.0800`	`-306.76901203`
`egout`	`0.0300`	`568.10070000`
`enigma`	`6.1600`	`0.00000000`
`fiber`	`2.0000`	`405935.18000000`
`fixnet6`	`11.5100`	`3983.00000000`
`gen`	`0.1900`	`112313.36271800`
`gesa2`	`11.2300`	`25779856.37169790`
`gesa2_o`	`42.3500`	`25779856.37169790`
`gesa3`	`11.6000`	`27991042.64838270`
`gesa3_o`	`13.1500`	`27991042.64838270`
`gr4x6`	`0.0300`	`202.35000000`
`gt2`	`0.0500`	`21166.00000000`
`harp2`	`1788.4700`	`-73889532.00000000`
`irp`	`244.0700`	`12159.49283600`
`khb05250`	`0.4600`	`106940226.00000000`
`l152lav`	`23.8300`	`4722.00000000`
`lseu`	`1.7700`	`1120.00000000`
`mas284`	`31.0800`	`91405.72368220`
`mas76`	`241.3000`	`40005.05414200`
`misc03`	`3.3400`	`3360.00000000`
`misc06`	`1.3400`	`12850.86073738`
`misc07`	`108.7200`	`2810.00000000`
`mitre`	`10.1600`	`115155.00000000`
`mod008`	`1.7800`	`307.00000000`
`mod010`	`1.1200`	`6548.00000000`
`mod011`	`248.0700`	`-54558535.01422730`
`modglob`	`30.0400`	`20740508.08630820`
`neos1`	`970.2200`	`19.00000000`
`neos4`	`42.0800`	`-4.8603440750589E+10`
`neos5`	`33.9300`	`-4.8603440750589E+10`
`neos6`	`441.4500`	`83.00000000`
`nw04`	`25.0300`	`16862.00000000`
`p0033`	`0.0600`	`3089.00000000`
`p0201`	`7.6800`	`7615.00000000`
`p0282`	`3.1900`	`258411.00000000`
`p0548`	`0.5800`	`8691.00000000`
`p2756`	`2.4300`	`3124.00000000`
`pk1`	`129.1600`	`11.00000000`
`pp08acuts`	`40.0900`	`7350.00000000`
`pp08a`	`75.2400`	`7350.00000000`
`prod1`	`134.6000`	`-56.00000000`
`qiu`	`293.6300`	`-132.87313695`
`qnet1`	`7.1300`	`16029.69268100`
`qnet1_o`	`6.2200`	`16029.69268100`
`ran10x10a`	`3.5300`	`1499.00000000`
`ran10x10b`	`2.3800`	`3073.00000000`
`ran10x10c`	`11.3300`	`13007.00000000`
`ran10x12`	`2.5900`	`2714.00000000`
`ran10x26`	`112.6900`	`4270.00000000`
`ran12x12`	`47.1800`	`2291.00000000`
`ran12x21`	`247.7600`	`3664.00000000`
`ran13x13`	`169.8700`	`3252.00000000`
`ran16x16`	`992.1700`	`3823.00000000`
`ran17x17`	`26.1100`	`1373.00000000`
`ran4x64`	`1.9500`	`9711.00000000`
`ran6x43`	`3.7100`	`6330.00000000`
`ran8x32`	`43.7500`	`5247.00000000`
`rentacar`	`6.0900`	`28882470.94755350`
`rgn`	`3.5000`	`82.19999924`
`rlp2`	`3.9600`	`19.00000000`
`stein27`	`2.9500`	`18.00000000`
`stein45`	`64.5800`	`30.00000000`
`swath1`	`743.8200`	`379.07129575`
`vpm1`	`0.2000`	`20.00000000`
`vpm2`	`8.6600`	`13.75000000`
`bell5`	`82.9300`	`8966406.49152000`

CBC20: feasible: Back to top

Modelname	Time (CBC20)	Obj (CBC20)
`arki001`	`1801.4900`	`7582515.66574672`
`bc1`	`1803.2900`	`3.33836255`
`bc`	`1801.8500`	`7.00000000`
`binkar10_1`	`1801.6600`	`6746.64002300`
`danoint`	`1800.9200`	`66.37500000`
`fast0507`	`1806.2800`	`179.00000000`
`mkc1`	`1800.4400`	`-607.20700000`
`mkc`	`1802.2200`	`-534.34200000`
`neos2`	`1800.5500`	`468.53452713`
`neos3`	`1800.7300`	`387.48814776`
`ran14x18`	`1802.8000`	`3735.00000000`
`rout`	`1802.4900`	`1077.56000000`
`set1ch`	`1802.4400`	`54555.00000000`
`seymour1`	`1825.8300`	`411.08574808`
`seymour`	`1802.5000`	`435.00000000`
`swath2`	`1801.1400`	`387.63980365`
`swath`	`1802.1400`	`517.86689600`
`markshare1`	`1804.5300`	`11.00000000`
`markshare2`	`1803.2400`	`14.00000000`
`mas74`	`1803.5200`	`11801.18572900`
`noswot`	`1758.7600`	`-41.00000000`

CBC20: fail: Back to top

Modelname	Time (CBC20)	Status (CBC20)
`acc-tight-2`	`--`	`mstat(13) sstat(13)`
`acc-tight-3`	`--`	`mstat(13) sstat(13)`
`acc-tight-5`	`--`	`mstat(13) sstat(13)`
`acc-tight-6`	`--`	`mstat(13) sstat(13)`
`dano3_3`	`--`	`mstat(13) sstat(13)`
`dano3_4`	`--`	`mstat(13) sstat(13)`
`dano3_5`	`--`	`mstat(13) sstat(13)`
`dano3mip`	`--`	`mstat(13) sstat(13)`

CBC12: all -- CBC20: all : Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 1e-5. For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the timelimit (1800 seconds). The shift is 10s for time and 0.0001 for timeratios. For gaps, an arithmetic mean is used. Only instances with relative gap are counted. Instances without a gap are counted with 1.

Modelname	Time (CBC12)	Time (CBC20)	Ratio (CBC12/CBC20)	Obj (CBC12)	Obj (CBC20)	ObjEst (CBC12)	ObjEst (CBC20)	Gap (CBC12)	Gap (CBC20)
`10teams`	`1800.3200`	`35.9300`	---	`mstat(14) sstat( 2)`	`924.00000000`	---	`924.00000000`	`---`	`0.0000`
`acc-tight-0`	`36.1500`	`3.8400`	`9.414`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-1`	`397.4500`	`6.0500`	`65.694`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-2`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`acc-tight-3`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`acc-tight-4`	`105.8300`	`8.5600`	`12.363`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-5`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`acc-tight-6`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`air03`	`5.0600`	`5.1800`	`0.977`	`340160.00000000`	`340160.00000000`	`340160.00000000`	`340160.00000000`	`0.0000`	`0.0000`
`air04`	`124.9700`	`298.6500`	`0.418`	`56137.00000000`	`56137.00000000`	`56137.00000000`	`56137.00000000`	`0.0000`	`0.0000`
`air05`	`348.7400`	`422.5000`	`0.825`	`26374.00000000`	`26374.00000000`	`26374.00000000`	`26374.00000000`	`0.0000`	`0.0000`
`arki001`	`1800.7300`	`1801.4900`	---	`mstat(14) sstat( 2)`	`7582515.66574672`	---	`7580317.76637409`	`---`	`0.0003`
`bal8x12`	`1.0100`	`1.7300`	`0.584`	`471.55000000`	`471.55000000`	`471.55000000`	`471.55000000`	`0.0000`	`0.0000`
`bc1`	`NA`	`1803.2900`	---	`mstat(13) sstat(13)`	`3.33836255`	---	`3.32613827`	`---`	`0.0037`
`bc`	`1801.5600`	`1801.8500`	---	`mstat(14) sstat( 2)`	`7.00000000`	---	`5.03076902`	`---`	`0.3914`
`bell3a`	`15.2900`	`3.1600`	`4.839`	`878430.31600000`	`878430.31600000`	`878430.31600000`	`878430.31600000`	`0.0000`	`0.0000`
`bienst1`	`NA`	`103.6800`	---	`mstat(13) sstat(13)`	`46.75000000`	---	`46.75000000`	`---`	`0.0000`
`bienst2`	`NA`	`762.9600`	---	`mstat(13) sstat(13)`	`54.60000000`	---	`54.60000000`	`---`	`0.0000`
`binkar10_1`	`1801.6600`	`1801.6600`	---	`mstat(14) sstat( 2)`	`6746.64002300`	---	`6729.06767310`	`---`	`0.0026`
`bk4x3`	`0.0000`	`0.0100`	`---`	`350.00000000`	`350.00000000`	`350.00000000`	`350.00000000`	`0.0000`	`0.0000`
`blend2`	`14.1500`	`12.4600`	`1.136`	`7.59898500`	`7.59898500`	`7.59898500`	`7.59898500`	`0.0000`	`0.0000`
`cap6000`	`57.7900`	`12.4000`	`4.660`	`-2451377.00000000`	`-2451377.00000000`	`-2451377.00000000`	`-2451377.00000000`	`0.0000`	`0.0000`
`dano3_3`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`dano3_4`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`dano3_5`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`dano3mip`	`NA`	`NA`	---	`mstat(13) sstat(13)`	`mstat(13) sstat(13)`	---	---	---	---
`danoint`	`1800.4100`	`1800.9200`	---	`mstat(14) sstat( 2)`	`66.37500000`	---	`63.41017254`	`---`	`0.0468`
`dcmulti`	`2.5200`	`6.7100`	`0.376`	`188182.00000000`	`188182.00000000`	`188182.00000000`	`188182.00000000`	`0.0000`	`0.0000`
`dsbmip`	`46.7700`	`1.0800`	`43.306`	`-306.76901203`	`-306.76901203`	`-306.76901203`	`-306.76901203`	`0.0000`	`0.0000`
`egout`	`0.0200`	`0.0300`	`---`	`568.10070000`	`568.10070000`	`568.10070000`	`568.10070000`	`0.0000`	`0.0000`
`enigma`	`14.6200`	`6.1600`	`2.373`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`fast0507`	`1811.0100`	`1806.2800`	---	`mstat(14) sstat( 2)`	`179.00000000`	---	`172.32418453`	`---`	`0.0387`
`fiber`	`4.4900`	`2.0000`	`2.245`	`405935.18000000`	`405935.18000000`	`405935.18000000`	`405935.18000000`	`0.0000`	`0.0000`
`fixnet6`	`8.7200`	`11.5100`	`0.758`	`3983.00000000`	`3983.00000000`	`3983.00000000`	`3983.00000000`	`0.0000`	`0.0000`
`gen`	`0.4800`	`0.1900`	`2.526`	`112313.36271800`	`112313.36271800`	`112313.36271800`	`112313.36271800`	`0.0000`	`0.0000`
`gesa2`	`89.8500`	`11.2300`	`8.001`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`0.0000`	`0.0000`
`gesa2_o`	`500.3600`	`42.3500`	`11.815`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`0.0000`	`0.0000`
`gesa3`	`5.2900`	`11.6000`	`0.456`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`0.0000`	`0.0000`
`gesa3_o`	`7.0600`	`13.1500`	`0.537`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`0.0000`	`0.0000`
`gr4x6`	`0.0200`	`0.0300`	`---`	`202.35000000`	`202.35000000`	`202.35000000`	`202.35000000`	`0.0000`	`0.0000`
`gt2`	`0.4700`	`0.0500`	`9.400`	`21166.00000000`	`21166.00000000`	`21166.00000000`	`21166.00000000`	`0.0000`	`0.0000`
`harp2`	`1800.8100`	`1788.4700`	---	`mstat(14) sstat( 2)`	`-73889532.00000000`	---	`+INF`	`---`	`+INF`
`irp`	`87.6500`	`244.0700`	`0.359`	`12159.49283600`	`12159.49283600`	`12159.49283600`	`12159.49283600`	`0.0000`	`0.0000`
`khb05250`	`0.2800`	`0.4600`	`0.609`	`106940226.00000000`	`106940226.00000000`	`106940226.00000000`	`106940226.00000000`	`0.0000`	`0.0000`
`l152lav`	`35.7100`	`23.8300`	`1.499`	`4722.00000000`	`4722.00000000`	`4722.00000000`	`4722.00000000`	`0.0000`	`0.0000`
`lseu`	`2.1400`	`1.7700`	`1.209`	`1120.00000000`	`1120.00000000`	`1120.00000000`	`1120.00000000`	`0.0000`	`0.0000`
`mas284`	`63.5000`	`31.0800`	`2.043`	`91405.72368220`	`91405.72368220`	`91405.72368220`	`91405.72368220`	`0.0000`	`0.0000`
`mas76`	`424.9300`	`241.3000`	`1.761`	`40005.05414200`	`40005.05414200`	`40005.05414200`	`40005.05414200`	`0.0000`	`0.0000`
`misc03`	`9.8400`	`3.3400`	`2.946`	`3360.00000000`	`3360.00000000`	`3360.00000000`	`3360.00000000`	`0.0000`	`0.0000`
`misc06`	`0.8300`	`1.3400`	`0.619`	`12850.86073738`	`12850.86073738`	`12850.86073738`	`12850.86073738`	`0.0000`	`0.0000`
`misc07`	`95.1000`	`108.7200`	`0.875`	`2810.00000000`	`2810.00000000`	`2810.00000000`	`2810.00000000`	`0.0000`	`0.0000`
`mitre`	`8.6200`	`10.1600`	`0.848`	`115155.00000000`	`115155.00000000`	`115155.00000000`	`115155.00000000`	`0.0000`	`0.0000`
`mkc1`	`1800.6000`	`1800.4400`	---	`mstat(14) sstat( 2)`	`-607.20700000`	---	`-607.21000000`	`---`	`0.0000`
`mkc`	`1800.5000`	`1802.2200`	---	`mstat(14) sstat( 2)`	`-534.34200000`	---	`-583.78559431`	`---`	`0.0847`
`mod008`	`1.2200`	`1.7800`	`0.685`	`307.00000000`	`307.00000000`	`307.00000000`	`307.00000000`	`0.0000`	`0.0000`
`mod010`	`8.3100`	`1.1200`	`7.420`	`6548.00000000`	`6548.00000000`	`6548.00000000`	`6548.00000000`	`0.0000`	`0.0000`
`mod011`	`264.7600`	`248.0700`	`1.067`	`-54558535.01422730`	`-54558535.01422730`	`-54558535.01422730`	`-54558535.01422730`	`0.0000`	`0.0000`
`modglob`	`38.7200`	`30.0400`	`1.289`	`20740508.08630820`	`20740508.08630820`	`20740508.08630820`	`20740508.08630820`	`0.0000`	`0.0000`
`neos1`	`1800.6300`	`970.2200`	---	`mstat(14) sstat( 2)`	`19.00000000`	---	`19.00000000`	`---`	`0.0000`
`neos2`	`30.9400`	`1800.5500`	`0.009`	`454.86469703`	`468.53452713`	`454.86469703`	`316.70562689`	`0.0000`	`0.4794`
`neos3`	`224.6600`	`1800.7300`	`0.062`	`368.84275100`	`387.48814776`	`368.84275100`	`-106.82749368`	`0.0000`	`4.6272`
`neos4`	`168.6800`	`42.0800`	`4.009`	`-4.8603440750589E+10`	`-4.8603440750589E+10`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`0.0000`	`0.0000`
`neos5`	`165.2900`	`33.9300`	`4.872`	`-4.8603440750589E+10`	`-4.8603440750589E+10`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`0.0000`	`0.0000`
`neos6`	`1801.3700`	`441.4500`	---	`mstat(14) sstat( 2)`	`83.00000000`	---	`83.00000000`	`---`	`0.0000`
`nw04`	`49.5300`	`25.0300`	`1.979`	`16862.00000000`	`16862.00000000`	`16862.00000000`	`16862.00000000`	`0.0000`	`0.0000`
`p0033`	`0.2400`	`0.0600`	`4.000`	`3089.00000000`	`3089.00000000`	`3089.00000000`	`3089.00000000`	`0.0000`	`0.0000`
`p0201`	`15.9700`	`7.6800`	`2.079`	`7615.00000000`	`7615.00000000`	`7615.00000000`	`7615.00000000`	`0.0000`	`0.0000`
`p0282`	`4.8200`	`3.1900`	`1.511`	`258411.00000000`	`258411.00000000`	`258411.00000000`	`258411.00000000`	`0.0000`	`0.0000`
`p0548`	`12.7100`	`0.5800`	`21.914`	`8691.00000000`	`8691.00000000`	`8691.00000000`	`8691.00000000`	`0.0000`	`0.0000`
`p2756`	`NA`	`2.4300`	---	`mstat(13) sstat(13)`	`3124.00000000`	---	`3124.00000000`	`---`	`0.0000`
`pk1`	`447.1800`	`129.1600`	`3.462`	`11.00000000`	`11.00000000`	`11.00000000`	`11.00000000`	`0.0000`	`0.0000`
`pp08acuts`	`763.5900`	`40.0900`	`19.047`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`0.0000`	`0.0000`
`pp08a`	`35.7800`	`75.2400`	`0.476`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`0.0000`	`0.0000`
`prod1`	`123.2600`	`134.6000`	`0.916`	`-56.00000000`	`-56.00000000`	`-56.00000000`	`-56.00000000`	`0.0000`	`0.0000`
`qiu`	`1800.1100`	`293.6300`	---	`mstat(14) sstat( 2)`	`-132.87313695`	---	`-132.87313695`	`---`	`0.0000`
`qnet1`	`8.1900`	`7.1300`	`1.149`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`0.0000`	`0.0000`
`qnet1_o`	`5.9500`	`6.2200`	`0.957`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`0.0000`	`0.0000`
`ran10x10a`	`10.4600`	`3.5300`	`2.963`	`1499.00000000`	`1499.00000000`	`1499.00000000`	`1499.00000000`	`0.0000`	`0.0000`
`ran10x10b`	`4.5800`	`2.3800`	`1.924`	`3073.00000000`	`3073.00000000`	`3073.00000000`	`3073.00000000`	`0.0000`	`0.0000`
`ran10x10c`	`12.0600`	`11.3300`	`1.064`	`13007.00000000`	`13007.00000000`	`13007.00000000`	`13007.00000000`	`0.0000`	`0.0000`
`ran10x12`	`9.6200`	`2.5900`	`3.714`	`2714.00000000`	`2714.00000000`	`2714.00000000`	`2714.00000000`	`0.0000`	`0.0000`
`ran10x26`	`537.9800`	`112.6900`	`4.774`	`4270.00000000`	`4270.00000000`	`4270.00000000`	`4270.00000000`	`0.0000`	`0.0000`
`ran12x12`	`248.1500`	`47.1800`	`5.260`	`2291.00000000`	`2291.00000000`	`2291.00000000`	`2291.00000000`	`0.0000`	`0.0000`
`ran12x21`	`1800.0200`	`247.7600`	---	`mstat(14) sstat( 2)`	`3664.00000000`	---	`3664.00000000`	`---`	`0.0000`
`ran13x13`	`534.5600`	`169.8700`	`3.147`	`3252.00000000`	`3252.00000000`	`3252.00000000`	`3252.00000000`	`0.0000`	`0.0000`
`ran14x18`	`1801.8300`	`1802.8000`	---	`mstat(14) sstat( 2)`	`3735.00000000`	---	`3518.02027632`	`---`	`0.0617`
`ran16x16`	`1800.0400`	`992.1700`	---	`mstat(14) sstat( 2)`	`3823.00000000`	---	`3823.00000000`	`---`	`0.0000`
`ran17x17`	`251.3200`	`26.1100`	`9.625`	`1373.00000000`	`1373.00000000`	`1373.00000000`	`1373.00000000`	`0.0000`	`0.0000`
`ran4x64`	`9.3100`	`1.9500`	`4.774`	`9711.00000000`	`9711.00000000`	`9711.00000000`	`9711.00000000`	`0.0000`	`0.0000`
`ran6x43`	`4.2400`	`3.7100`	`1.143`	`6330.00000000`	`6330.00000000`	`6330.00000000`	`6330.00000000`	`0.0000`	`0.0000`
`ran8x32`	`1800.0100`	`43.7500`	---	`mstat(14) sstat( 2)`	`5247.00000000`	---	`5247.00000000`	`---`	`0.0000`
`rentacar`	`11.6400`	`6.0900`	`1.911`	`28882470.94755350`	`28882470.94755350`	`28882470.94755350`	`28882470.94755350`	`0.0000`	`0.0000`
`rgn`	`NA`	`3.5000`	---	`mstat(13) sstat(13)`	`82.19999924`	---	`82.19999924`	`---`	`0.0000`
`rlp2`	`97.6400`	`3.9600`	`24.657`	`19.00000000`	`19.00000000`	`19.00000000`	`19.00000000`	`0.0000`	`0.0000`
`rout`	`1801.5800`	`1802.4900`	---	`mstat(14) sstat( 2)`	`1077.56000000`	---	`1044.66808848`	`---`	`0.0315`
`set1ch`	`1801.4900`	`1802.4400`	---	`mstat(14) sstat( 2)`	`54555.00000000`	---	`54189.68297590`	`---`	`0.0067`
`seymour1`	`1802.2400`	`1825.8300`	---	`mstat(14) sstat( 2)`	`411.08574808`	---	`409.91158207`	`---`	`0.0029`
`seymour`	`1802.0600`	`1802.5000`	---	`mstat(14) sstat( 2)`	`435.00000000`	---	`410.06537513`	`---`	`0.0608`
`stein27`	`2.1700`	`2.9500`	`0.736`	`18.00000000`	`18.00000000`	`18.00000000`	`18.00000000`	`0.0000`	`0.0000`
`stein45`	`57.4100`	`64.5800`	`0.889`	`30.00000000`	`30.00000000`	`30.00000000`	`30.00000000`	`0.0000`	`0.0000`
`swath1`	`579.6000`	`743.8200`	`0.779`	`379.07129575`	`379.07129575`	`379.07129575`	`379.07129575`	`0.0000`	`0.0000`
`swath2`	`1800.6400`	`1801.1400`	---	`mstat(14) sstat( 2)`	`387.63980365`	---	`371.94441583`	`---`	`0.0422`
`swath`	`1800.6400`	`1802.1400`	---	`mstat(14) sstat( 2)`	`517.86689600`	---	`354.06052185`	`---`	`0.4627`
`vpm1`	`1.3800`	`0.2000`	`6.900`	`20.00000000`	`20.00000000`	`20.00000000`	`20.00000000`	`0.0000`	`0.0000`
`vpm2`	`9.6500`	`8.6600`	`1.114`	`13.75000000`	`13.75000000`	`13.75000000`	`13.75000000`	`0.0000`	`0.0000`
`markshare1`	`1803.9500`	`1804.5300`	---	`mstat(14) sstat( 2)`	`11.00000000`	---	`0.00000000`	`---`	`11.0000`
`markshare2`	`1803.0400`	`1803.2400`	---	`mstat(14) sstat( 2)`	`14.00000000`	---	`0.00000000`	`---`	`14.0000`
`mas74`	`1800.0400`	`1803.5200`	---	`mstat(14) sstat( 2)`	`11801.18572900`	---	`11649.49567611`	`---`	`0.0130`
`bell5`	`1802.7200`	`82.9300`	---	`mstat(14) sstat( 2)`	`8966406.49152000`	---	`8966406.49152000`	`---`	`0.0000`
`noswot`	`1800.5900`	`1758.7600`	---	`mstat(14) sstat( 2)`	`-41.00000000`	---	`-43.00000000`	`---`	`0.0465`
mean	209.57	114.26	2.04	---	---	---	---	0.38	0.16
unsolved	36.36%	26.36%